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ABSTRACT 


Rotating machinery such as gears plays an important 





role in control of an aircraft. The condition of this 
machinery is a key ingredient to both platform safety and 


mission success, especially in military operations. The 





purpose of the thesis research is to establish a vibration 
threshold level for each particular gear in CH-53 aircraft 


such that, while minimizing in-flight risk, a negligible 





false alarm rate is obtained. 





This study uses Box-Jenkins time series modeling 
(ARMA) with regression, Mahalanobis distance metrics, 


goodness-of-fit tests and the Bonferroni correction to 








explore the structure of the historical acquisition 


datasets for particular gear type and aircraft, to set 





vibration threshold values for “Warning” and “Alarm” 
Situations. Although 28 datasets could not be modeled 


because of small sample sizes, the other 224 data sets were 








successfully modeled using ARMA with regression modeling 
technique. The Mahalanobis distance metric was then used to 


set a threshold value of “Warning” and “Alarm” for each 








gear type. These threshold values wer then checked with 


new data and 200 outliers for “Warning” and 69 outliers for 








“Alarm” were detected. These outliers might be evaluated as 





false alarms. 
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EXECUTIVE SUMMARY 


The purpose of this study was to establish a vibration 
threshold level for each particular gear in CH-53 aircraft 


such that, while minimizing in-flight risk, a negligible 





false alarm rate is obtained. Aircraft safety is a very 





important issue to the military. Every precaution should 
be taken to minimize risk to the aircraft crew. The basic 


concept for threshold setting is to pick a threshold value 








high enough such that the worst aircraft, while still 


healthy, would not give a false alarm. 


The data used in this study was supplied by Goodrich 
Corporation Fuel & Utility Systems. The data consist of 
23,187 acquisitions and 20 attributes for 63 gear types and 


four different tail-numbered CH-53E aircraft. The data 











includes seven condition indicators! (CI) (See Table 1 in 











Chapter ) for each gear type. To calculate a threshold 





value, first, 252 individual data sets wer created from 








the entire data for each particular gear and tail number. 





Each of the seven CIS were considered as a univariate time 


series. 


Box-Jenkins Autoregressive Moving Average Models 


(ARMA) were used to model each of these univariate time 





series. Examining the time plots for each CI, it was 
observed that almost all of them were plausibly stationary. 


The autocorrelation and partial autocorrelation plots were 





then examined to determine the order of Autoregressive (AR) 





1 “Condition indicator (CI) is nothing more than an algorithm. For 
example, residual kurtosis measured the kurtosis of the time domain 
signal after the major gear and shaft rates hav been removed” 
(Goodrich Corporation Fuel & Utility Systems, 2003). 





x1il 


and Moving Average (MA) components. Based on these plots, 


ARMA(1,1) models were suggested. Then we added the torque 





effect as a regression variable to our models becaus it 











was believed that torque affected the CIs. The standardized 





residuals of each CI model wer used to set threshold 





values of “Warning” and “Alarm”. 


Our analysis was based on detecting any unusual level 





in CI values. For this purpose, we used the Mahalanobis 
distance, which is a multivariate distance metric. This 
analysis provided insight about the expected range of the 


distance metric for a specific healthy gear type. 


Next, we needed to find the distribution, which would 


fit to each Mahalanobis distance data set. Most of the 





histogram plots for the Mahalanobis distance data sets for 


a particular gear type and tail number looked as if they 





came from exponential distributions. 


However, we applied Chi-Square and Kolmogorov-Smirnov 
goodness-of-fit to verify if the Mahalanobis distance data 


sets came from exponential distributions. Since more than 








one goodness-of-fit test was performed, in order to control 





Type I error, we applied the Bonferroni multiple comparison 





correction which assured an overall Type I error no greater 
than 0.05. Using the Bonferroni adjusted goodness-of-fit 


tests, 84% of the data sets using Chi-square and 87.5% of 





the data sets using Kolmogorov-Smirnov produced  non- 
significant results with respect to the null hypothesis 


specifying the exponential distribution. Therefore, we set 








threshold values for “Warning” and “Alarm” using the 


critical values of the exponential distributions of those 














data sets. The basic concept for threshold setting was to 


Xiv 


pick a threshold high enough that the worst aircraft, while 
still healthy, would not give a false alarm. For this 


reason, as a rule of thumb, we used a 0.999 quantile level 





for “Warning”, and a 0.999999 quantile level for “Alarm” 


threshold levels. 
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ns INTRODUCTION 


A. BACKGROUND 


The United States Navy, in association with Goodrich 


Corporation Fuel & Utility Systems, is continuously seeking 


th false alarm rates for and 





ways to decreas “Warning” 














“Alarm” in different types of aircraft using the vibration 
data collected during the operational flights. 

Rotating machinery such as pumps, gears and 
transmissions are used in vehicles, ships and aircraft. 
These components support critical functions that aid in 
power, stability, propulsion and control of these 
platforms. The health of this machinery is a key ingredient 
to both platform safety and mission success, especially in 


military operations. 
Components subject to cyclic fatigue conditions 
develop cracks in critical high-stress locations 
as a result of pre-existing machining or 
manufacturing-—induced defects, poor operating 
conditions (loss of lubrication, etc. leading to 
fretting damage) , foreign object damage, 
environmental factors (corrosive environments and 
resulting pitting damage) or excessive loading. 
Such interactions, ither between new components, 
new and worn components, and healthy or 
fatigued/damaged components, coupled with the 
difficulty in determining exact crack initiation 
sites makes it difficult to predict remaining 
component life. Practical real-time optical or 
strain measurement using conventional sensor 
technologies has not proven reliable for 















































production purposes 


(Goodrich Corporation Fuel & 


Utility Systems, 


2003). 





Techniques 
machinery use 


obtained from 


designed to 
component-—level 


analyzing the 


assess 


the health 
state-awareness 


vibration 


of 


signal. 


this 





indicators 


These 


indicators are categorized as either normal, warning or 





alarm. There are some reliable indicators that already are 





used to ascertain the health of each component and the 


corresponding assembly (group of components) at a specific 





instance in time. Despite the improvement in probability 





of detection and false alarm rate, current health 





assessments do not relate previous and remaining component 


life. 


There are two mechanical diagnostic tests that can be 


performed. The first is a usage-based test. The second is 








measurement—based. The usage-based test calculates the 


worst-case damage that a new part could accumulate before 





failure. Th real-tim damage is recorded and reflects 
actual flight conditions such as airspeed and maneuvers. 
The proportion of real-time damage to worst-case damage is 
considered the usage of the aircraft component. This 
method does not account for manufacturing defects, 


corrosion or faulty maintenance. On the other hand, the 








measurement—based test uses an accelerometer close to the 
component that measures the vibration felt by that 


component. This test is used to infer the current health 





of the component. Our analysis relies on measurement—based 
data. The following describes the process by which 
component health is measured. 


An acquisition takes configuration data which 
consists of gear, bearing and shaft information, 









































and calculates a health index (HI) based on a 
number of CIs. The gear information consists of 
the number of teeth, the RPM, the shaft on which 
it is mounted and sensor. The health of the 
component is calculated (currently) by taking 
consensuses of CIs used for that part. For 
example, in the case of gears, 7 CI’s (See Table 
1 ain Chapter ) are used. If three CIs are 


2 





greater than three standard deviations above the 
normal mean level, the component is considered in 
“Warning” and if there are 3 CIs greater than 6 
standard deviations, the component is in alarm 














(Goodrich Corporation Fuel & Utility Systems, 

2003). 

A false alarm occurs when the health index (HI) is in 
warning or alarm when it should be in normal. One of the 


most important issues is to minimize the number of false 





alarms during operations. But on the other hand, undetected 


faults can result in catastrophic failures. There must be 





a balance between these objectives. 








In this thesis, we will deal with the gear data and 
our goal is to determine a threshold value of “Warning” and 


“Alarm” for each particular gear of CH-53E type 








helicopters, and to obtain reasonable false alarm rates. 


B. OBJECTIVE 


The purpose of the thesis research is to establish a 








vibration threshold level for each particular gear in the 


CH-53 aircraft such that, while minimizing in-flight risk, 





a negligible false alarm rate is obtained. 








This thesis will benefit the military by ensuring a 


lower false alarm rate on its helicopters. This will help 











to decrease ownership costs, which include the replacement 








and/or maintenance of any helicopter component as a result 


of a false alarm. 


The vibration data for CH-53 helicopters was provided 


by Goodrich Corporation Fuel & Utility Systems. The data 








was collected collected between July 1, 2001 and September 





1, 2003 during operational tests and it includes different 





CIs related to accelerometers and gears for each specific 


6) 


tail number. The entire data consists of A231 80) 


observations on 20 attributes. 


Cc. SCOPE 

Helicopter safety is a very important issue to the 
military. The lives of the crew on the helicopter are 
precious and every precaution to minimize risk while flying 
should be taken. A naive model would set a very low 


threshold level to ensure that no failure occurs in flight. 





This model is impractical due to cost constraints. A low 














threshold would requir frequent replacement of the 
components of the helicopter, at a high cost. The 
thresholds must be set high enough such that a false alarm 


is a rare event. Therefore, the goal of this thesis is to 











determine if a threshold level exists for each particular 


gear in an aircraft such that, while minimizing in-flight 





risk, a negligible false alarm rate is obtained. 





D. COURSE OF STUDY 











This thesis is comprised of four chapters. Chapter 





reviews the previous work by the Goodrich Corporation 


FueléUtility Systems (Bechhoefer, 2003) and describes the 








dataset used for the analysis. It also explains the 








statistical models and techniques used for the study. 














Chapter describes univariate Box—Jenkins (ARMA) 





modeling with regression analysis, Mahalanobis metric 





analysis, goodness-of-fit test analysis and the Bonferroni 





correction procedure. Chapter IV summarizes the conclusions 
of the analysis and presents recommendations for further 


study. 


II. DATA AND METHODOLOGY 


A. PREVIOUS STUDY AND DATASET 


1. Previous Study 








Data acquisitions are made by the Integrated 





Mechanical Diagnostic-Health and Usage Management Systems 








(IMD HUMS) installed on CH-53 aircraft. An accelerometer 


mounted closest to the component sends a signal that is 





used to measur th vibrations of the component. The 


acquired vibration data is then processed in the vibration 





processing unit (VPU). The VPU is used to calculate a HI 





based on CIs. The VPU can process up to eight channels at a 


time. Each channel process four seconds of acquired data 





in about one minute (Goodrich Corporation Fuel & Utility 


Systems, 2003). 


A desired vibration threshold setting for each 
particular gear is high enough so that even a healthy 


aircraft with the most aged gears does not indicate false 





alarms. One method for setting the threshold values for 





warning and alarm is to model the variance between aircraft 


and to add a correction for different predefined ranges of 








torque (torque bands). Initially, the least squares method 





is applied to the CI values which are assumed to be 
randomly sampled from a seven-dimensional normal 
distribution. This method uses the data coded into an 
information matrix format organized by aircraft type and 


torque bands. After the least squares fit method is 


applied, the estimated condition indicators (C/) and the 








sample variance for each CI are calculated. An adjustment 


is made for additional components of variance arising from 
5 


selection of the sample’s aircraft from the population. 


These calculations use assumptions of normality, 





independence and homoscedasticity. A CI is considered to be 


in a “Warning” state when its value is three standard 





deviations above the mean. The computation of the standard 





deviation includes an adjustment for variability between 








aircraft and between torgue bands: the value of three is 





chosen from Normal theory. Similarly, a CI is considered to 





be in an “Alarm” state if the value is six standard 





deviations above the mean (Bechhoefer, personal 


communication, October 01, 2003). 





The HI of a component is calculated by taking a 





consensus of a particular part’s CIs. As in the case of 











gears, ther ar seven CIs to take into account. These 








seven CIs for each particular gear are given in Table 1. 








Condition Indicator Name Variable Name 





Residual Kurtosis Residual kurtosis 

















Residual Root-—Mean-Square (RMS) | Residual_rms 



































Gear Distributed Fault GearDisFault 
Frequency Module Peak-to-Peak fmP2P 
Sideband Modulation 1 sm_l 
Sideband Modulation 2 sm_2 

Signal Average Ratio RMS sigAvg_rms 

















Table 1. List of Seven CIs for Each Particular Gear 











If three of the seven CIs exceed the normal mean level 





by three standard deviations or more, the component is in a 


6 





“Warning” state. Similarly, if three of the seven CIs 








exceed the normal mean level by more than six standard 


deviations, the component is in an “Alarm” state. The study 








shows that visibly damaged parts typically have CI values 6 





to 8 standard deviations larger than the normal mean level. 














Severely damaged parts have CI values which are at least 12 
standard deviations above the normal mean level (Goodrich 


Corporation Fuel & Utility Systems, 2003). 


The current approach, however, makes assumptions about 





the data that are untenable. The assumption that each CI 


follows the normal distribution (conditional on aircraft 





and torque bands) has not been tested. The creation of 





torque bands discards some information; presumably, by 
considering torque to be continuous, we can better exploit 


that data. Most seriously, the current approach’s 





computations assume that the data are like independent 


random samples, whereas in reality there is ae strong 








element of time-dependenc within each set of data (See 





Chapter ae 














2. Data Used in the Analysis 
The data set consists of 23,187 acquisitions and 20 


variables. These variables are: 





e Tail Number 

° Accelerometer Name 

e Torque 

e Gear Name 

e Gear Index 

° Accelerometer Signal to Noise Ratio (SNR) 
e Accelerometer Root-Mean-Square (RMS) 

° Accelerometer Clipping 








vi 





e Accelerometer Low Frequency Intercept 


e Accelerometer Low Frequency Slope 





e Accelerometer Analog-to-Digital Converter 
(ADC) Bits Used 





























° Accelerometer Dynamic Range 

° Residual Kurtosis 

e Residual RMS 

e Gear Distributed Fault 

° Frequency module peak to peak 
e Side Modulation 1-2 

° Signal Average RMS 


Tail: This variable consists of the tail number of each 


aircraft for each acquisition. Table 2 provides a list of 





the sample sizes for each tail number. 





























Tail Number | Total Acquisitions 
162494 5934 
163075 2437 
163086 3461 
164539 11335 
Table 2. Number of Acquisitions for Each Tail Number 





Accelerometer Name/Part: The dataset includes acquisitions 





from 21 different accelerometer names and part names, which 





are represented in Table 3. 








































































































































































































Accelerometer Name Accelerometer Part | Number of Acquisitions 
AGBAft DTA30 1532 
AGBFwd DTA29 2681 
IGBInput DTA32 52 
IGBOut put DTAO7 1392 
MGBRear DTA23 1062 
No2Input DTA12 3186 
OilCooler DTA22 354 
OilCoolerTakeOff DTA28 354 
PortInputHanger DTA13 609 
PortMain DTA18 850 
Port NGBInput DTAO8 609 
PortNGBOilCooler DTA24 19:15 
Port NGBOutput DTA10 1218 
PortRing DTA16 1360 
TbdMain DTA19 170 
TbdNGBInput DTA11 609 
StbdNGBOilCooler DTA25 1149 
StbdNGBOut put DTAOY 609 
TGBInput DTA31 208 
TGBOutput DTAO5 696 
TailTakeoOff DTAO06 2572 
Table 3. List of Accelerometer Names and Parts 








Torque: Torque is a force or system of forces that tend to 


cause rotation. The data includes the different torque 





levels 


test flights. 





applied by each helicopter during the operational 























































































































Gear Name/Index: These two variables include 63 type of 
gears and the associated index numbers of those gears. 
Table 4 provides the list of gear names and the total 
number of acquisitions for each of those gears. 

Gear Name Size | Gear Name Size | Gear Name Size 
2EngFCDrvShftSpur 354 AuxLbVnPmpShftBlades 170 PortNGBTachShftSpur 383 
2EngFrwhShftCamGear 354 AuxLbVnPmpShftGear 170 RrCovidlerShftIdler 354 
2EngFrwhShftDrvSpur 354 GrndStglRing 170 SmpRotPmpShftBlades 170 
2EngFrwhShftSpur 354 GrndStg2Ring 170 SmpRotPmpShftGear 170 
2EngInpShftSpur 354 IGBInpShftPin 52 StbdAftInpDrvShftPin 170 
2EngTachShftSpur 354 IGBOutShftGear 696 StbdNGBEngInpShftPin 609 
2GenShftSpur 354 TGBOut ShftPumpBlades 696 StbdNGBFCDrvShftGear 383 
2InpShftAftIdler 354 MainRtrShftOPSpur 170 StbdNGBOPDrvShftSpur 383 
2InpShftIdler 354 MainRtrTachShftSpur 354 StbdNGBOutShftPin 609 
2InpShftPin 354 OilCoolShftSpur 354 StbdNGBTachShftSpur 383 

AGBActShftIdler 3o3 OuterShaftMainBev 170 StglHydPmpShftSpur 354 

AGBActShftSpur 383 OuterShaftSunGear 170 Stg1PlntShftGear 170 

AGBDrvShftGear 383 PortAftInpDrvShftACCPi 609 Stg2PlntShftGear 170 

AGBDrvShftSpur 383 PortAftInpDrvShftPin 170 Stg2SunShftGear 170 

AGBEngStrtShftSpur 383 PortNGBEngInpShftPin 609 TRTakeoffShftSpur 1286 

AGBGen#1ShftSpur 383 PortNGBFCDrvShftGear 383 TGBInpShftGear 52 

AGBGen#3ShftSpur 383 PortNGBFCDrvShftLHZerl 383 TGBInpShftPin 52 

AGBOPShftSpur 383 PortNGBFCDvnShftLHZerl 383 TGBOilPmpShftBlades 52 

AGBStg2SrvPmpShftSpur 383 PortNGBOPDrvShftSpur 383 TGBOilPmpShftGear 52 

AGBUtPmpShftSpur 383 PortNGBOut ShftACcCSpur 609 TGBOutShftGear 696 

AGBWchPmpShft Spur 383 PortNGBOutShftGear 609 TTOIdlerShaftIdlerSpur 1286 

Table 4. Gear Names and Number of Acquisitions 


10 








For the remaining variables the text from Goodrich 


Corporation Fuel & Utility Systems (2003) is attached. 


Signal to Noise Ratio (SNR): Each data channel 
has a specified observed SNR associated with it. 
Before the vibration data is calibrated, a power 
spectral density is calculated from the data set. 
Each component in the data channel has known 
frequencies associated with it. SNR measures th 

excess strength of a known tone (corrected for 
operational speed differences) above the minimum 
baseline levels in a user-defined bandwidth. 


























Root Mean Square (RMS): The overall energy level 
of the vibration is represented by the RMS value 
of the raw vibration amplitude. Major overall 
changes in the vibration level can be detected by 
the RMS value. 














Clipping: For a specific gain value, the raw ADC 
bit values cannot exceed a specific calculated 
value. There is no clipping in the data used in 
this analysis. 





Frequency Slope and Low Frequency Intercept: 
These CIs were installed in the algorithm per 
Navy request. Using the first 10 points of the 
power spectral density estimated from the raw 
data, a simpl linear regression is performed to 
obtain the intercept and slope in the frequency 

amplitude domain. 





























ADC Bit Use: ADC Bit Use measures the number of 
ADC bits used in the current acquisition. The 
ADC board is typically a 16 bit processor. The 
log base 2 value of the maximum raw data bit 
acquired is rounded up to the next highest 
integer. Channels with inadequate dynamic range 
typically use less than 6 bits to represent the 
entire dynamic range. 


























ADC Sensor Range: ADC Sensor Range is the maximum 
range of the raw acquired data. This range 
cannot exceed the operational range of the ADC 
board, and the threshold value of 32500 is just 
below the maximum permissible value of +32767 or 
-—32768 when the absolute value is taken. 











iT 








Dynamic Range: Dynamic Range is similar in spirit 
to the ADC Sensor Range, except the indicator 
reports dynamic channel range as a percent rather 
than a fixed bit number. 








Kurtosis: The fourth moment (Kurtosis) of the 








distribution has the ability to enhance the 
sensitivity of tail changes. It has a value of 3 
(Gaussian distribution) when the machinery is 


healthy. Kurtosis values, larger than 3.5, are 
usually an indication of localized defects. 
However, distributed defects such as wear tend to 
smooth the distribution and thus decreas th 
Kurtosis values. 








Gear Distributed Fault (GDF): GDF is thought to 
be an ffectiv detector for distributed gear 
faults such as wear and multiple tooth cracks. 
GDF is calculated from the formula below 














_ StdDev(RS) 
StdDev( Al) 


GDF 


RS = residual data 


Al 





signal average 








Peak-To-Peak (P2P): The Peak-To-Peak value of the 
raw vibrating amplitude represents the difference 
between the two vibration extreme. When failures 
occur, the vibration amplitude tends to increase 
in both upward and downward directions and thus 
the Peak-To-Peak value increases. 














Sideband Modulation (SM): SM analysis is designed 
to reveal any sideband activities that may be the 











results of certain gear faults such as 
eccentricity, misalignment, or looseness 
(Goodrich Corporation Fuel & Utility Systems, 
20:03) % 


B. METHODOLOGY 
The goal of this analysis is to compute a threshold 
value for each particular gear type and tail number, so 


that a single numerical value can be used to track the wear 
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on each gear. In order to calculate this threshold value, 


a new data set of a single gear and tail number was created 





from the whole data _ set. This was done using the 
make.datanew function in S-PLUS. The code for this function 
is presented in Appendix A. This function created 252 


different data sets from the 63 gear types and four unique 





tail numbers. Each of the seven CIs (See Table 1) for each 
data set was considered to behave as a univariate time 


series. 


1 Univariate Time Series 


Since the data was obtained continuously over a time 





interval, each of the CIS was assumed to be equally spaced 





in time and to exhibit univariate time series behavior. 





A "univariate time series" consists of scalar 
observations recorded sequentially with equal time 
intervals between observations. For ease of analysis, 


univariate time series data sets are usually displayed in 








column form. In a univariate time series, time is an 
implicit variable. Properties of a time series data set, 


such as stationarity, seasonality and trend, must be 











considered befor starting the analysis (NIST SEMATECH, 
2003). 


a. Stationarity 





Stationarity is often assumed for data that 


follows a time series pattern. Under the stationarity 


assumption, the mean, variance and autocorrelation 
structure remain constant over time. Graphically, 
stationary series exhibit no apparent trends. Time plots 





are very useful because nonstationarity can often be 








detected from a study of the plot (NIST SEMATECH, 2003). 
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For our study, time plots were used to examine if 





each CI data for a particular gear and tail number is 





stationary or not. To draw the time plot for each gear CI, 
the “timeplot” function in Appendix A was used. 

b. Seasonality 

Seasonality refers to the periodic fluctuations 


in a data set. We tested for seasonality since we are 





dealing with a time series. If the presence of seasonality 


is observed it must be considered in our time series model. 





There are several graphical methods with which to 


detect th presenc of seasonality. These include time 





plots, seasonal sub-series plots and multiple box plots. 





The analyst must know the seasonal period to be able to use 





sub-series plots or multiple box plots. For our data, the 


seasonal period is unknown; therefore the preferred method 











was to use time plots. An alternate course of action would 


be to use the autocorrelation plot to detect seasonality. 











If there are seasonality spikes (sudden increases) in the 





plot, they can be observed at lags equal to the period 
(NIST SEMATECH, 2003). 








Cc: Trend 


A trend in a data is the movement in a direction 








over a long-term period of time. It is defined by the added 


influence of many factors that will affect the time series 





in a consistent and gradual way over a long period of time 








(Ragsdale, 2001, p. 509). We used time plots to detect the 
presence of trends in our data sets. 

d. Time Plots 

Once the background information was gathered and 
the objectives are carefully defined, the next and most 


important step was to plot the data versus time. Time 
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plots graphically summarize a univariate data set in a way 





that makes ain easy to analyze and understand 
characteristics of the data set. Characteristics that can 
be detected from time plots include trend, seasonality, 


outliers, and discontinuities. The time plot is also a very 





useful tool for the analyst, because it assists Seal 
describing the data and formulating a plausible model 


(Chatfield, 1996, p.11). Time plots are formed by using the 








time variable on the horizontal axis, and a response 


variable on the vertical axis. 





For our study, we plotted every gear CI of a data 





set for a particular gear type and tail number using the 
“timeplot” function in Appendix A to detect seasonality or 


trends. 


2. Autocorrelation 





In a time series model, there is often correlation 


between observations at different time lags. These 





correlations are estimated by sample autocorrelation 





coefficients, which can be used to provide insights into 
the probability model from which the data may have been 
drawn. Given N pairs of observations on two variables x and 


y, the correlation coefficient is 





X(x,-*)(¥,-¥) 
(e@-27 50-7) | 


r= 





(1) 





This same idea can be applied to time series models to 





check for correlation between successive CI observations 


(Chatfield, 1996, p.19). 
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have 





If we N pairs of CI 


(KiXe ls (eX sth ewe chive: -farest 


coefficient between X, and X,,, is given by 








observations 


order 








successive CI 


such as 


correlation 


observations 


(4) 





coefficient 


where the mean of the first and last N-1 CI 
are 
N-1 
Xay = pas /(N-1) 
t=l 
N 
Xa) = > x, /(N-1) 
t=2 
respectively. The correlation between 
observations is called an autocorrelation 
(Chatfield, 1996, p.19). 
Since %y =X». and N/(N-1) gets close to one for large 


sample sizes, a 





Similarly the correlation between CI 


distance k apart is given by 


N-k 


(4 =F O50“) 





i= 


16 


simpler formula can be given by 


(5) 


observations a 


This is called the autocorrelation coefficient at lag k 


(Chatfield, 1996, pp.19-20). 





In our study, we used autocorrelation to identify an 


appropriate time series model. To accomplish this’ we 





plotted autocorrelation functions for each CI varying the 





number of lags. There are two types of graphical methods 





that show autocorrelations. 


a. Autocorrelation Plots 





In this study, we used autocorrelation plots to 


identify the order of a moving average model (MA) (See 





Section B.3). To draw the autocorrelation plots of each CI, 


the “draw.acf.plots” function in Appendix A was used. 


Autocorrelation plots lead us to discover where 
the function approaches a zero value and ultimately the 
order of the Moving Average (MA) model, which is denoted as 


q (NIST SEMATECH, 2003). 








b. Partial Autocorrelation Plots 


The partial autocorrelation at lag k is the 





autocorrelation between X; and X:-, not conveyed through the 





intervening values. The autoregressive (AR) (See Section 
B.3) order of a Box-Jenkins (ARMA) model is commonly 


identified through the use of partial autocorrelation plots 





(NIST SEMATECH, 2003). Detailed information about the 











partial autocorrelation function can be found in Brockwell 


and Davis (1996). 








In our study “draw.acf.plots” function in 





Appendix A was used to draw partial autocorrelation plots 








of each CI. W determined the order of an AR model by 


examining the lag where the function approached zero. 








Details about calculating the order of AR model can be 
found in Section B.3 (NIST SEMATECH, 2003). 
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3. Time Series Models 
a. Autoregressive (AR) Models 
A commonly used approach for modeling univariate 


time series is through applying an AR model to the series. 





The general form of the AR model applied is AR(p): 
X,= OX At at. - +9,X,,+&, (7) 


where X, 





1S the. Time -Sertes! and: £158 “a white: noLses series: 


An autoregressive model can simply be thought of as a 
linear regression relationship between the current value 
and one or more prior values of the series. The order of 


the AR model is known as p (NIST SEMATECH, 2003). 








Examining the partial autocorrelation plots leads 





us to discover where the function approaches a zero value. 





Since the AR(p) process becomes zero at lag ptl and 





greater, we can now deduce the value of p. If an AR model 
is shown to be appropriate from the analysis of a sample 


autocorrelation plot, then we can use the analysis of the 





sample partial autocorrelation plot to help identify the 








order of the AR model. For this study the range of values 





within the 95% confidence intervals are accepted as zero 








values (NIST SEMATECH, 2003). 





After examining the partial autocorrelation plots 





of each CI for each data set of a particular gear and tail 
number, the order of the AR model was determined to often 
be p=1. The AR(1) is given by 

X,= @X_+ E, (8) 





In an AR(1) model, x depends on the value it 


previously held. This characteristic should prevent large 
jump sizes from X;-; to X;. The value of @ should be 
between -1 and 1 (Chatfield, 1996, p.35). For this study 
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we chose @ = 0.8 as a starting value because it usually led 
to convergence in the software. 

b. Moving Average (MA) Models 

The MA(q) model is described as follows: 


X,= HE, — 4, €,,-9, €,4-- « -—G, &,, (9) 
where. X, 1s the time. series, €25 are white noise, and 
GOs gee 5 Oe “ane “Che: parameters Of “the.-model (Chatiield, 
19.96, Ds33)< 


Examining the autocorrelation plots leads us to 


discover where the function approaches a zero value. Since 








the MA(q) process becomes zero at lag gti and greater, we 





can now calculate the value of q. For this study the range 
of values within the 95% confidence intervals are accepted 


as zero values (NIST SEMATECH, 2003). 








After examining the autocorrelation plots of each 








CI for each data set of a particular gear, and tail number, 





the order of the MA model was determined to often be one. 


The moving average model of order one, which is MA(1), is 








given by: 
X,= €-60,&,, (10) 
In an MA(1) model, xX, depends on the value of the 
immediate past error, which is known at time t. This 


characteristic should prevent large jump sizes from X,, to 


xX (Chatfield, 1996, p.34). The value of @ should be 


t 


between -1 and 1. For this study we used the value of @ 











where the optimizer converged for most of the CI models, 


which was @ = 0.2. 


Through the analysis of the autocorrelation 











function (ACF) plots and the partial autocorrelation 
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function (PACF) plots, we observed that a combination of 





these two models (AR and MA) would best fit to each CI data 


of particular gear type and tail number. Therefor W 








applied Box-Jenkins (ARMA) Models. 
C: Box-—Jenkins Models (ARMA) 





The Box-Jenkins ARMA (Autoregressive Integrated 
Moving Average) model is a combination of the AR and MA 


models previously discussed. The first main assumption of 





the Box-Jenkins ARMA models is that the time series is 


stationary. So we must first ensure that there is 














stationarity in all of the univariate CI time series. If 





non-stationarity is observed in the time series data, Box 





and Jenkins recommend a process called differencing that 
can be applied one or more times to achieve stationarity 


(NIST SEMATECH, 2003). 











For our study, each CI of a data set for a 


particular gear and tail number was plotted against time. 





It was observed from these plots that each particular data 





set was stationary or almost so. Therefore, w did not 


need to apply the differencing process. 





The general form of an ARIMA model is 





ARIMA (p,d,q). Since the data exhibited no apparent 





deviations from the stationarity, we fit an ARMA model 





setting the differencing value to zero. The general 


ARMA (p,q) model is given as: 


A OX 4-0, Xo =e s HO, X= 6,7 6 E49, Eng. HOE (11) 


t-q 


Now that we have a model without differencing, we 
need to identify the orders (i.e., the p and q) of the 


autoregressive and moving average terms. After examining 








ACF and PACF plots for every CI of a particular gear type 
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and tail number, both p and g values were estimated as one. 





Therefore to model each gear CI data, we used an ARMA (1,1) 


model given by 


X,= OX,,+ €-GO86&,, (12) 








To model the univariate time series model for each CI, we 





used the “arima.mle” function that is built in to S-PLUS®. 


Providing the starting values of the ARMA model 
parameters (@ and 9) is necessary for the optimizer. Poor 
starting values can lead to slow convergence to a local 


maximum (S-PLUS 2000 Guide to Statistics, Volume 2, pp.177, 














1999). 

d. ARMA Models with Regression Variable 

At this point, we added the torque effect to our 
model. It is believed that there is a relation between the 








torque and the CI levels. Therefore, w added torque as a 





regressor variable to each univariate time series model for 





each Cavs To accomplish this, the S-PLUS function 
“arima.mle” was used. This function allows us to add torque 
as an additive regressor variable to our models via the 
“xreg” optional argument. After adding the torque effect, 


our general model is given by 
a= gp X,,+ E,- 0 €,,+ f+ BT, (13) 


where 6; is the intercept, B2 is the slope and Te is the 








torque value at time t for the regression model. Detailed 
information about ARMA models with regression variables can 
be found in S-PLUS 2000 Guide to Statistics, Vol 2, pp.173, 
1999). 
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e. Standardized Residuals 





A residual is defined as the differenc between 


the observed value and the fitted value. A standardized 





residual equals the residual divided by its estimated 


standard error. 





So far, we have modeled each CI for every data 


set of a particular gear type and unigue tail number. Since 





the variances of every modeled CI vary considerably from 








one CI to another, it is rather difficult to know whether a 
fitted residual should be considered large or small. 


Therefore, Ww use standardized residuals, which are 





independent of the units of measurement of the variables. 





In particular, standardized residuals provide a statistical 











metric for determining the size of a residual for each CI. 


Because of this fact, we decided to use the standardized 








residuals of each modeled CI as our new CIs for the rest of 





the analysis. Therefore, w created new CI matrices for 








each particular gear and tail number data set using the 





function “make.newcl” in Appendix A (SSI Scientific 


Software, 2003). 





After modeling each of the seven CIs (See Table 1 














in Chapter ) given in Table 1 for each data set, the 








standardized residuals of each CI model were saved. The 


seven standardized residual vectors were then used to 





create new CI matrices for each data set corresponding to a 


particular gear type and tail number. 
4. Mahalanobis Metric 
The general form of the Mahalanobis metric is given by 


r= (ea) C." (X-M,) (14) 
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where X is the new CI matrix consisting of seven CI (See 














Table 1 in Chapter ) vectors, 





Chis £55CRQ) 
X=| ° (15) 


Cl(n), . . . ,CL(n) 


n : number of the acquisitions for each CI 





CI, : Residual kurtosis 








CI, : Residual rms 





Cl, : Gear Distributed Fault 


CI, : Fm Peak-to-Peak 











CI, : Side modulation 1 
CI, : Side modulation 2 and 
CI, : Signal Average rms 


The mean. of the Cl. 1s represented by 


be AG) 
A, = |— (16) 
n 
The mean: vector mM, is 
My=| 4, Hy Hh Hy Hs He 1 | (17) 


and the covariance matrix C is given by 
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[Cov(l,l) . . .  Covi,7) | 
Cov(2,1) . . .  Cov(2,7) 
Col(X)=Cy =| ; (18) 
|Cov(7,) =...) Cov(7,7)| 








The Mahalanobis metric is commonly used to. detect 





outliers in a multivariate data set which includes two or 


more variables of interest (dependent variable). The 








Mahalanobis metric does not treat all CI values equally 
when calculating the distance from the mean vector; instead 
it weights the differences by the range of variability and 
by the vectors’ covariances. The Mahalanobis measurement 


is also useful for discrimination since the distances are 





calculated in units of standard deviations from the mean 


vector (Thermo Galactic, 2003). 


Our analysis is based on detecting any unusual level 





at «Cl values relating to pre-existing machining or 
manufacturing-induced defects, poor operating conditions 
(loss of lubrication), foreign object damage, environmental 
factors (corrosive environments and resulting pitting 
damage) or excessive loading. We know that no failure 
occurred during the collection of each data set for each 


particular gear type and tail number. Therefore, by 





calculating the Mahalanobis distances for each of these 
data sets, we gain insight about the expected range of the 


Mahalanobis distances. If the Mahalanobis distance of any 











acquisition is bigger than a given threshold value, we can 





conclude that there might be a defect in that particular 


gear. 
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After calculating the Mahalanobis distances for each 





data set, we must then find a specific distribution which 








best fits the set of Mahalanobis distance vectors of all 





data sets. By accomplishing this we can set a Mahalanobis 








threshold value for each particular gear type and tail 





number. Then this threshold value will be used to detect 








any defective gears. 


5. Goodness-of-Fit Tests 
a. Chi-Square Goodness-of-Fit Test 


To set a threshold value for each gear type, we 














need to fit the Mahalanobis distances to a specific 
distribution. In this study, the chi-square goodness-of-fit 
test was used to test if the calculated Mahalanobis 








distances of each data set for a particular gear type and 





tail number fit to an exponential distribution. 


The chi-square goodness-of-fit test can be 
applied to any univariate distribution for which the 


cumulative distribution function can be calculated. Chi- 





square goodness-of-fit test is applied to binned data (NIST 
SEMATECH, 2003). 


The chi-square test null hypothesis and 


alternative hypothesis are 


Ho: The data follows a specific distribution 





Ha: The data does not follow a specific 


distribution. 


The chi-square goodness of fit computation uses 





the following test statistic: 


2 
(O,-E,) /E, (19) 


1 


2 


Xx 


k 
t= 


25 





where k is the number of bins, O, is observed frequency for 





bin i and £,is th xpected frequency for bin i. The 





xpected frequency is calculated by using 
E, = N(F(,)-(F®)) (20) 


where the cumulative distribution function for the 
distribution being tested is F, the upper limit for class i 


ae ° iy 


the lower limit for class iis Y, and the sample 


size is N. 


The null hypothesis was accepted if 
2 2 
Xx < Xx (a@,k—c-1) 


where c is the number of estimated parameters and Ross as 


the critical value from the chi-square distribution with k- 











c degrees of freedom and a significance level of a. (NIST 
SEMATECH, 2003). 
b. Kolmogorov-Smirnov Goodness-of-Fit Test 


The Kolmogorov-Smirnov (K-S) test is an 





alternative goodness-of-fit test that is used to decide if 





a sample comes from a population with a specific 
distribution. For our study, the K-S goodness-of-fit test 
was also used as an alternative to test if the calculated 


Mahalanobis distances of each data set for a particular 








gear and tail number fit an exponential distribution. 


The K-S test is based on the empirical 


distribution function. Given N ordered data points 





Visto desea le y - be “enparueal Ci StrlLbutlor “Tunce bon. se -detined 


as 


Ey =n(i)/N (25 
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where nv(i) is the number of points less than Y, and the /Y, 





are ordered from smallest the largest value. This is a step 





function that increases by 1/N at the value of each ordered 





data point. An attractive feature of this test is that the 





distribution of the K-S test statistic itself below does 








not depend on the underlying cumulative distribution 

















function being tested. Despite this advantage, the K-S test 


has several important limitations: 





° It only applies to continuous distributions. 





e It tends to be more sensitive near the center of 
the distribution than at the tails (NIST 
SEMATECH, 2003). 





The K-S test null hypothesis and alternative 


hypothesis are 


Ho: The data follows a specific distribution. 





Ha: The data does not follow a specific 


distribution. 





The K-S test statistic is defined as 





i 
D=mex| FOr) (22) 


where F is the theoretical cumulative distribution of the 





continuous distribution being tested. The hypothesis 


regarding the distributional form is rejected if the test 





statistic, D, is greater than the critical value obtained 








from a table. Ther ar several variations of these tables 














in the literature that use somewhat different scaling for 








the K-S test statistic and critical regions. These 





alternative formulations should be equivalent, but it is 





necessary to ensure that the test statistic is calculated 
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in a way that is consistent with how the critical values 


were tabulated (NIST SEMATECH, 2003). 








6. Bonferroni Correction/Adjustment Procedure 





In our study, we performed 224 goodness-of-fit tests. 
Conventionally, the q@ level is set at 0.05 for each Chi 


square and K-S goodness-of-fit test. 





If we perform more than one statistical test, the 





probability of observing at least one test statistically 





Significant due to chance fluctuation, and to incorrectly 





declare a difference to be true (Type I error), increases 





(Simple Interactive Statistical Analysis (SISA), 2003). 








Since we performed a total of 224 hypothesis tests, 








the probability of making Type I error increases from the 





conventional value of .05. Our purpose is to control the 





Type I error, the decision to reject the null hypothesis 
(Ho: The Mahalanobis data set follows a specific 


distribution) when it is, in fact, true. 


The Bonferroni is used when more than one statistical 
test in a particular study are being performed 
simultaneously. The Bonferroni correction procedure adjusts 


the @ level of each individual test downwards to ensure 





that the overall risk for a number of tests remains 0.05. 
To accomplish this, instead of using the @ significance 


level for each test in an entire set of n comparisons, the 





Bonferroni correction sets the @ value for each test to 


a/n (Weistein, 2003). 





In our study, the Bonferroni adjusted level of 





significance was calculated as 0.05/224 = 0.0002193 . The null 


hypothesis was rejected for any test that resulted in a 
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probability of less than 0.0002193 which was statistically 
significant. The null hypothesis was accepted for the tests 


with a probability value greater than 0.0002193. See 














Chapter , section C, for results of this analysis. 
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III. ANALYSIS 


A. UNIVARIATE BOX-JENKINS (ARMA) MODELLING ANALYSIS 


1. Model Identification Analysis 
a. Stationarity, Seasonality and Trend Analysis 
The first step in developing a time series model 
is to determine if the series is stationary and if there is 
any Significant seasonality or trend that needs to be 


modeled. 


Using the “timeplot” function in Appendix A, each 








of the CIs for a particular gear type and tail number was 








plotted against time. After examining each of these plots, 





it was observed that almost all of them were plausibly 








stationary. Since non-stationarity was not observed in our 





univariat tim series data sets, we did not need to use 


differencing. Figures 1 through 3 provide a few examples of 





these plots indicating stationarity. 





Time Series Plots For Each CI 











25°30:35.40 
0.15 0.25 0.35 


Residual.rms. 
06 08 1.0 1.2 
GearDisFault 











0.01 0.03 0.05 
sm.2 


0.15 0.25 0.35 0.45 














5m. 
0.01 0.020.030.04 











ntl 


50 100 150 200 
time 











Figure 1. Time Plots of The CIs For Gear Type 
“AGB Wch Pmp Shft Spur” and Tail Number “164539” 
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Time Series Plots For 
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Figure 2. Time Plots of The CIs For Gear Type 
"TGB Out Shft Gear" and Tail Number “164539” 
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Figure 3. Time Plots of The CIs For Gear Type 
"IGB Out Shft Pump Blades" and Tail Number “162494” 








32 


b. Autoregression (AR) and Moving Average (MA) 
Order Analysis 





Since the above time series plots of each CI and 








the others for particular gear type and tail number did not 





exhibit any significant non-stationarity or seasonality, we 





generated the autocorrelation and partial autocorrelation 


plots of the raw data to decide about the orders ARMA(p,q) 





models. For this purpose, w used the “plot.acf.plots” 
function in Appendix A. Figures 4 through 6 provide a few 


examples of these plots. 
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Autocorrelation Plots for CIs 
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Partial Autocorrelation Plots for CIs 


Residual kurtosis Residual RMS Gear Dis. Fault 
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Figure 4. Autocorrelation and Partial 
Autocorrelation Plots for CIs of Gear Type “AGB Wch Pmp 
Shft Spur” and Tail Number “164539” 
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Autocorrelation Plots for CIs 


Residual kurtosis Residual RMS Gear Dis. Fault 
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Partial Autocorrelation Plots for CIs 
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Figure 5. Autocorrelation and Partial 
Autocorrelation Plots for CIs of Gear Type "TGB Out Shft 
Gear" and Tail Number “164539” 
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Autocorrelation Plots for CIs 


Residual kurtosis Residual RMS Gear Dis. Fault 
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Partial Autocorrelation Plots for CIs 
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Figure 6. Autocorrelation and Partial 
Autocorrelation Plots for CIs of Gear Type "IGB Out Shft 
Pump Blades" and Tail Number “162494” 
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Autocorrelation function plots display the 


coefficients starting from lag 0 to lag 25. Dashed lines 





mark off approximate 95% confidence bands. Most of the 
autocorrelation and partial autocorrelation plots with a 
95% confidence band showed that the autocorrelation at lag 


1 was significant. Based on these plots, ARMA(1,1), was 








suggested. For convenienc W used a single model 





A= OX 47+ €-@ €.,. Eor every Cl of gear and tail ‘number. 





Since it is believed that torque affects the CI 


levels, we added torque effect to our single ARMA(1,1) 





model as a regression variable and the single model changed 














to X,= @X,,+ 6-06, +B+AT, . See Chapter ;. SSCE16n: “Bas 





for details. Then, we modeled 252 univariate CI time series 








for 63 different types of gears and 4 different tail 


numbered aircraft. 


2. Model Validation Analysis 








Having developed the models, diagnostics were checked 





to determine if the models were reasonable. Specifically, 





standardized residual plots were analyzed to determine if 
ARMA (1,1) with regression variable models were valid 


models. 


A plot of the standardized residuals over time is the 
single most important diagnostic for time series model 
validation. By examining the standardized residual plots, 


we can detect outliers, non-homogeneity of variance, and 





obvious structure in time. If our model is correct, then 


standardized residuals should look approximately like a 





Gaussian white noise (purely random) process with zero mean 
and unit variance (S-PLUS 2000 Guide to Statistics, Vol 2, 


pew 9; 1999): 
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Another method for time series model validation is to 








examine the autocorrelation function of the residuals. If 





our models ar adequate, then th autocorrelations of the 





residuals should be uncorrelated and approximately Gaussian 
random variables with mean zero and variance n”“. Therefore, 


observing large autocorrelations indicates that our models 





may be inadequate (S-PLUS 2000 Guide to Statistics, Vol 2, 
pe.179, 1999). Figures 7 through 13 provide an example of 
ARMA(1,1) with regression variable model diagnostic graphs 


for each of the CIs for the gear type “AGB Wch Pmp Shft 





Spur” and Tail Number “164539” (description of the 


individual parts of the graphs follow). 


ARIMA Model Diagnostics for Residual kurtosis 


Plot of Standardized Residuals 
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Figure 7. ARMA Model Diagnostics for CI “Residual 
kurtosis” of Gear Type “AGB Wch Pmp Shft Spur” and Tail 
Number “164539” 
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ARIMA Model Diagnostics for Residual RMS 


Plot of Standardized Residuals 
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ACF Plot of Residuals 
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Figure 8. ARMA Model Diagnostics for CI “Residual 
RMS” of Gear Type “AGB Wch Pmp Shft Spur” and Tail Number 
“164539” 





ARIMA Model Diagnostics for Gear Dis. Fault 


Plot of Standardized Residuals 





100 


ACF Plot of Residuals 





























Lag 


ARIMA(1,0,1) Model with Regression Parameters 0.16 











Figure 9. ARMA Model Diagnostics for CI “Gear 
Dis. Fault” of gear type “AGB Wch Pmp Shft Spur” and Tail 
Number “164539” 
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ARIMA Model Diagnostics for fmP2P 


Plot of Standardized Residuals 
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ARIMA(1,0,1) Model with Regression Parameters 0.24 











Figure 10. ARMA Model Diagnostics for CI “fmP2P” 
of Gear Type “AGB Wch Pmp Shft Spur” and Tail Number 
“164539” 
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ARIMA(1,0,1) Model with Regression Parameters 0.02 











Figure 11. ARMA Model Diagnostics for CI “sm.1” of 
Gear Type “AGB Wch Pmp Shft Spur” and Tail Number 
“164539” 
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ARIMA Model Diagnostics for sm.2 


Plot of Standardized Residuals 
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ARIMA(1,0,1) Model with Regression Parameters 0.02 








Figure 12. ARMA Model Diagnostics for CI “sm.2” of 


Gear Type “AGB Wch Pmp Shft Spur” and Tail Number 
“164539” 





ARIMA Model Diagnostics for sigAvg rms 
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ARIMA(1,0,1) Model with Regression Parameters 5.21 





Figure 13. ARMA Model Diagnostics for Ci 


“sigAvg.rms” of Gear Type “AGB Wch Pmp Shft Spur” and 
Tail Number “164539” 
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Ljung-Box, a randomness test based on autocorrelation 





plot, is commonly used to test the quality of fit of a time 


series model. The model is determined to pass the test if a 





significant correlation is not observed. However, instead 


of testing randomness at each distinct lag, Ljung-Box tests 





the overall randomness based on a number of lags. For this 











reason, it is often referred to as a “portmanteau” test 


(Burn Statistics, 2003). 


First, we examined standardized residuals graphs for 


each CI ARMA model. All the standardized residuals behave 





approximately like a Gaussian white noise process and there 





is no obvious structure in time. Standardized residuals of 





each model for CIs are uncorrelated and approximately 


Gaussian random variables with mean zero and unit variance. 


As a second test for model validation, we examined the 





autocorrelation function of the residuals. It was observed 


that the autocorrelations of the residuals were 





uncorrelated and approximately Gaussian random variables 


Lig 


with mean zero and variance n~’ For this case our sample 





size n was equal to 216. Almost no large residual values 


were observed. Similar results were obtained from the other 








models for different gear types and tail numbers. 








Therefore, we concluded that our models were adequat 


However, in 28 out of 252 models, for a particular 
gear type and tail number, the arima.mle() function did not 


converge, presumably because of the small sample sizes. A 





list of these data sets is provided in Table 5. 
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Gear Index/Name Tail Number Sample Size 
19 AGB Stg2 Srv Pmp Shft Spur | 162464 90 
22 Aux Lb Vn Pmp Shft Blades 163075 15 
23 Aux Lb Vn Pmp Shft Gear 163075 TD 
24 Grnd Stg 1 Ring 163075 lee) 
25 Grnd Stg 2 Ring 163075 15 
26 IGB Inp Shft Pin 163075,164539 4,9 
29 Main Rtr Shft OP Spur 163075 15 
32 Outer Shaft Main Bev 163075 dle) 
33 Outer Shaft Sun Gear 163075 15 
35 Port Aft Inp Drv Shft Pin 163075 15 
45 Smp Rot Pmp Shft Blades 163075 15 
46 Smp Rot Pmp Shft Gear 163075 TD 
47 Stbd Aft Inp Drv Shft Pin 163075 Aigo) 
53 Stg 1 Hyd Pmp Shft Spur 163086 52 
54 Stg 1 Plnt Shft Gear 163075 15 
55 Stg 2 Plnt Shft Gear 163075 15 
56 Stg 2 Sun Shft Gear 163075 15 
58 TGB Inp Shft Gear 163075,163086, 164539 | 4,20,9 
59 TGB Inp Shft Pin 163075,163086,164539 | 4,20,9 
60 TGB Oil Pmp Shft Blades 163075,164539 4,9 
61 TGB Oil Pmp Shft Gear 163075,164539 4,9 
Table 5. The List of Data Sets, which could not be Modeled 
Due to the Small Sample Sizes. 
After modeling each of the seven CIs (See Table 1 in 
Chapter ) for a particular data set, the new CI matrices 
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were created by taking the standardized residuals of each 





of those CI models. Then for the rest of the analysis we 


used these new matrices. To accomplish this, we used the 














fuction “make.newci” in Appendix A. See Chapter , section 


B.3.e for details. 


B. MAHALANOBIS METRIC ANALYSIS 








We have a multivariate data set of CIs for each data 


set of a particular gear type and tail number. As we stated 





previously, since no failure occurred during the collection 
of our data, we can assume that all the gears in each 
aircraft are healthy. Therefore, calculating the 


Mahalanobis metric, a multivariate distance metric, should 





give usS an insight about the expected range of the 





Mahalanobis distances for a specific healthy gear type. 





Then, we can use this information for each data set to set 


a threshold value in order to detect any unusual level in 








these CI values relating to pre-existing machining or 
manufacturing-—induced defects, loss of lubrication, 
corrosive environments and resulting pitting damage or 


excessive loading. 





Using the new CIs of 224 data sets which we managed to 
model, we calculated the Mahalanobis distances. To 


accomplish this, the function “make.mahanew” in Appendix A 











was used. See Chapter ‘ Section B.5 for Mahalanobis 





Metric details. 








Next, we wanted to determine which distribution would 
fit best to each of these Mahalanobis distances data sets. 
By accomplishing this, we would be able to set threshold 


values of “Warning” and “Alarm” for each particular gear 
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type and tail number. Then this threshold values can be 





used to detect any defective gears. 


Histograms graphically summarize the distribution of a 


univariate data set and provide strong indications of the 








proper distributional model of the data. Therefore, we used 
histograms to have an idea about which population 
distribution the Mahalanobis data sets might come from. 
Figure 14 provides some of these histograms for different 


gear types and tail numbers. These histograms looked very 





much like those from exponential distributions. But we 
needed to verify that. To accomplish this, goodness of fit 


tests were used. 
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Figure 14. Mahalanobis distances histograms for 
different gear types and tail numbers 
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Cc. GOODNESS OF FIT TESTS ANALYSIS AND BONFERRONI 
CORRECTION PROCEDURE 


Chi-Square and K-S goodness-of-fit tests were applied 


to decide if a sample set of Mahalanobis distances came 














from an exponential distribution. See Chapter , section 








B.4 for details about Chi-Square and K-S goodness-of-fit 


tests. 





For each goodness-of-fit test, the a level is 





conventionally set to 0.05. Since we performed 224 tests on 





the same hypothesis, the probability of making a Type 





error would increase from the conventional @ value of 0.05, 











but we wanted to control Type I error. In order to do this, 





we applied the Bonferroni multiple comparison correction. 





Therefore our new Bonferroni adjusted level of significance 


was calculated as 0.0002193. 





Any test that results in a probability value of less 


than 0.0002193 was accepted as statistically significant. 








Similarly, any test statistic with a probability value of 


greater than 0.0002193 (including values that fall between 





0.0002193 and 0.05) was deemed non-significant. Chi Square 
and K-S goodness-of-fit test results are provided in 
Appendix B. The Bonferroni adjusted goodness-of-fit test 


results are summarized in the Table 6. 











Test Type # of Non-significant tests Percentage 
K-S 196 87.5 
Chi-Square 188 84 




















Table 6. The Summary of the Goodness-of-Fit Test results 
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Then, using the population exponential distributions 


the threshold values for “Alarm” and “Warning” were set for 








a particular gear type and tail number. If any Mahalanobis 





distance occurs greater than 0.999 quantile level, the 
related gear was considered in “Warning” and if any 


Mahalanobis distance greater than 0.999999 quantile, the 





gear was considered in “Alarm”. The calculated threshold 





values for specific gear types and tail numbers are 


provided in Appendix C. 
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IV. SUMMARY, LIMITATIONS AND RECOMMENDATIONS 


The purpose of this study was to establish a threshold 
level for each particular gear in CH-53 aircraft such that, 


while minimizing in-flight risk, a negligible false alarm 











rate is obtained. This would help us decrease the costs, 


which includ th replacement and/or maintenance of any 





aircraft component, as a result of a false alarm. These 
thresholds must be set high enough such that a false alarm 


is a rare event. 


The vibration data collected during operational tests 


was provided by the Goodrich Corporation Fuel & Utility 








Systems. The dataset included different CIs related to 
accelerometers and gears for each specific tail number. The 
entire data consisted of 23187 observations and 20 


variables for 63 gear types and four aircraft. Only seven 





CI columns, related to a particular gear type and tail 
number, were used to set a threshold value through the 


analysis. 


To calculate a threshold value, first, 252 individual 








data sets wer created from the entire data, each for a 





particular gear and tail number. Each of the seven CI 


columns was considered as a univariate time series. 





Box-Jenkins ARMA Models were used to model each of 





these univariate time series. In developing a time series 











model, the characteristics of each univariate time series 





data set was analyzed. Time plots were used to accomplish 


this. Examining each of these time plots, it was observed 








that almost all of them were plausibly stationary. Since 





the univariate data sets did not exhibit any significant 
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non-stationarity, the autocorrelations and partial 


autocorrelation plots were then examined to determine th 











order of the AR and MA components. Most of them looked like 





AR(1) and MA(1). Therefore, based on these plots ARMA(1,1) 
was suggested. Torque was added to our models as a 


regression variable because it was believed that torque 





affected the CIs. However, in 28 out of 252 data sets for a 
particular gear type and tail number the arima.mle() 
function did not converge, presumably because of small 


sample sizes. 


Having developed the models, standardized residual 





plots were used to check the diagnostics to determine if 
the models were reasonable. These plots proved that our 


model, ARMA(1,1) with torque as a regression variable, was 





very often an adequate model. 





Since the variances of every modeled CI varied 





considerably from one CI to another, it was rather 
difficult to know whether a fitted residual should be 


considered large or small. Therefore, standardized 








residuals from each CI model for a particular gear type and 


tail number wer saved as a single vector and then these 








seven CI vectors were used as our new CIs for the rest of 





the analysis in order to set threshold values of “Warning” 


and “Alarm.” 











As stated previously in Chapter , our analysis was 











based on detecting any unusual level in CI values relating 





to pre-existing machining or manufacturing-induced defects, 
loss of lubrication, corrosive environments and resulting 
pitting damage or excessive loading. For this purpose, we 


used the Mahalanobis distance, which is a multivariate 





distance metric. Mahalanobis metric provided insight about 
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the expected range of this distance for a specific healthy 





gear type. Therefore, Mahalanobis distances were calculated 








using the new CIs for each of the 224 data sets which were 


modeled successfully. 


Next, we needed to find the distribution which would 


fit each Mahalanobis distance data _ set. Most of the 





histogram plots for the Mahalanobis distance data sets for 
a particular gear type and tail number looked very much as 


if they came from an exponential distribution. However, we 








applied Chi-Square and K-S goodness-of-fit to verify that. 











We performed 224 individual goodness-of-fit tests. In 
order to control Type I error, we applied the Bonferroni 
multiple comparison correction, which allowed 224 


comparisons while still assuring an overall alpha value no 








greater than 0.05. In each case the null hypothesis 





specified that the Gites came from the exponential 
distribution, and in 84% of the data sets using the 


(Bonferroni-adjusted) chi-square goodness-of-fit test, and 





in 87.5% using the Kolmogorov-Smirnov, that null hypothesis 





was not rejected. We set threshold values for “Warning” and 
“Alarm” FOr those data sets reported as plausibly 


exponential using quantiles of the exponential distribution 





with the parameter estimated from the data. The basic 





concept for threshold setting was to pick a threshold high 





enough that the worst aircraft, while still healthy, would 








not give a false alarm. For this reason, as a rule of 





thumb, we used 0.999 quantile level for the Warning 


threshold, and 0.999999 quantile level for the Alarm 








threshold. But when we checked if there was any warning and 





alarm situation according to these new threshold values, 


200 outliers for “Warning” and 69 outliers for “Alarm” were 
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detected. These outliers would be evaluated as false 
alarms. Of course, this was not expected since we knew that 


no failure occurred during the collection of the data used 





in this analysis. Even when w used the 0.999999999 


quantile we still observed 38 outliers. Additionally, 








sometimes there was a big difference between the threshold 








levels set for each aircraft for the same gear type. 


One of the reasons that this technique may not be 
sufficient to provide a reasonable warning and alarm rate 


is that we do not have all the information we might need. 





Different aircraft might have used different torque level 
patterns during their flights. Data gathered with torque 
slowly increasing might be very different than data with 


torque decreasing, especially in time series modeling. For 





instance, data collected during a flight pattern with 





torque level small, medium and then large might be very 





different than the data with torque level large, medium and 








then small. We might try to set different threshold values 








for the same gear type if we had data collected applying 


different torque levels. 


Another reason for setting different and unreasonable 


threshold values for the same gear type might be that 





different aircraft had different amount of vibration data 


for the same gear type. 








In future studies attention needs to be paid to 





patterns of data gathering. It would be valuable to have 
large data sets, from a number of aircraft, covering some 
of the torque patterns most often encountered during real 


operations. We expect that these patterns might be quite 





different depending on the different missions assigned to 








the aircraft. Further studies might help determine whether 
52 





torque history has an effect on CI or whether it is 
sufficient to consider only the instantaneous value of 


torque. 
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APPENDIX A. S-PLUS FUNCTIONS 


Special thanks to Professor Samuel Buttrey for 
supplying his knowledge in writing the following S-PLUS 


functions. 


1. make.datanew function 


function(gears, tails, names.only = F) 


{ 


Create a gear data set for a particular gear and tail 
number. If "names.only" is TRUE, just produce the set of 
names and return them. 








Arguments: 
gears: vector of character string with name of gear 


c 


tails: vector of character string with tail number 








Se SE OSE SHE SHE HSH SHE 














if(names.only) { 
out <- character(length(gears) * length(tails) ) 
nm.ctr <- 1 





} 






































for(i in l:length(gears)) { 

datagear <- ac[ac[, "GearName"] == gears[i], ] 

i.txt <- gears[i] 

if (substring(i.txt, 1, 1) == "#") 
i.txt <- substring(i.txt, 2, nchar(i.txt)) 

if (substring(i.txt, 9, 9) == "#") 
ay ste ete <- paste (substring(i.txt, 1,8), 
substring(i.txt, 10, nchar(i.txt)), collapse = 


Ww m4 





i.txt <- unlist(unpaste(i.txt, sep = ")) 
Latxkt <= “d.txt [atx ba] 
i.txt <- paste(i.txt, collapse = "") 
for(j in l:length(tails)) { 
j.txt <-tails[j] 
datageartail <- datagear[datagear 









































[,"Tail"]== j.txt, ] 
# 
# Construct the name of the thing to be 
# saved 
# 
nm <- paste("ac.", i.txt, ".", J.txt, 


sep = mw) 


she) 


if(names.only) { 
out[nm.ctr] <- nm 
mm.ctr <- nm.ctr + 1 

} 

else f{ 
if (!'exists (nm, 


et 


where = 


cat ("Creating object",nm, 


"\n") 


assign(nm, datageartail,where = 1) 


} 
else 
created\n") 


} 


cat (nm, "already 


} 
} 
if (names.only) 
return (out) 
return (invisible ()) 
return (datageartail) 








2. timeplot function 


function(gears, tails) 


{ 


# Arguments: 




















exists; not 


# gears: vector of character string with name of gear 
# tails: vector of character string with tail number 
for(i in l:length(gears)) { 





countgears = i 

i.txt <- gears[i] 

if (substring(i.txt, 1, 1) == "#") 

i.txt <- substring(i.txt, 2, 

if (substring(i.txt, 9, 9) == "#") 
i.txt <- paste(substring(i.txt, 1, 






































8), substring(i.txt, 10, 
i.txt)), collapse = "") 
i1.txt <- unlist(unpaste(i.txt, sep = " 








etxt[i.txt != ""] 


<- paste(i.txt, collapse = "") 
for(j in l:length(tails)) { 
counttails = j 
j.txt <- tails[j] 
nm <- paste("ac.", 
if (!exists (nm) ) 


i.txt <- i 


























nchar (i.txt) ) 


nchar ( 


ab 


isteeg th eet gsep =") 


stop (paste("No data set named",nm) ) 





# 

#it exists go and get it 
# 

data <- get (nm) 
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plotname = paste("Gear:",i.txt,"TN:", 3.txt) 


par(mfrow = c(3, 3)) 
gearCIs <- names(ac[14:20]) 























k = 0 
for(i in 14:20) f{ 
kK =ke4+i1 
plot(data[, i], type = "1", 
xlab="time",ylab =gearCIs[k]) 
if(i == 14) { 
title(main = plotname) 
} 
} 
if(counttails != length(tails)) { 
graphsheet () 
} 
} 
if(countgears != length(gears)) { 


graphsheet () 
} 


3. draw.acf.plots function 
function(gears, tails) 
# Arguments: 


# gears: vector of character string with name of gear 
# tails: vector of character string with tail number 


















































for(i in 1:length(gears) ) 
{ 
countgears = i 
i.txt <- gears[i] 
if (substring(i.txt, 1, 1) == "#") 
i.txt <- substring(i.txt, 2, nchar(i.txt)) 
if (substring(i.txt, 9, 9) == "#") 
i.txt<-paste (substring (i.txt,1,8) 








, 
substring(i.txt, 10, nchar(i.txt)),collapse = "") 
i.txt <- unlist(unpaste(i.txt, sep = " ")) 

Lvtxt <- L.txt[istxt ta 0""] 
i.txt <- paste(i.txt, collapse = "") 
for(j in l:length(tails)) { 
counttails = j 
j.txt <- tails[j] 
nm <- paste("ac.", i.txt, ".", j.txt, sep = "") 
if (!exists (nm) ) 
stop (paste("No data set named", nm) ) 





























# 
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4. 


{ 


t exists go and get it 








# 

data <- get (nm) 

data <- data[14:20] 

data <- as.matrix (data) 

par(mfrow = c(3, 3)) 

k = 0 

for(i in 1:7) { 
k =k+#+1 
acf(data[, i]) 

} 

par(mfrow = c(3, 3)) 

k = 0 

for(i in 1:7) { 
k =k+#+1 
acf(data[, i], type = 


} 
if (counttails 
graphsheet () 
} 
} 
if(countgears != length(gears)) { 
graphsheet () 
} 


make.newci function 
































p") 


'= length(tails)) { 





function(gears, tails) 
# 
# Create a gear data set for a particular gear and 
# tail number. 
# 
# Arguments: 
# gears: vector of character string with name of gear 
# tails: vector of character string with tail number 
for(i in l:length(gears)) { 
i.txt <- gears[i] 
if (substring(i.txt, 1, 1) == "#") 
i.txt <- substring(i.txt, 2, nchar(i.txt)) 
if(substring(i.txt, 9, 9) == "#") 
i.txt<-paste(substring(i.txt,1,8), 
































i.txt <- unlist(unpaste(i.txt, 
isExt <— Tetxt-[ivtxt tS] 
i.txt <- paste(i.txt, collapse = 
for(j in l:length(tails)) { 


j.txt <- tails[j] 
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substring(i.txt,10,nchar(i.txt)),collapse= "") 
sep = " 


Wr) 


Ww my 


# 
#Construct the name of the thing to be saved 
# 
nm<-paste("ac.",1i.txt, ".", j.txt, sep = "") 
if (!exists (nm) ) 

stop (paste("No data set named", nm) ) 





# 

#it exists go and get it 
# 

data <- get (nm) 





for(k in 1:7) { 






































if(k == 1) ¢ 
zap.Res.kur<-— 
arima.mle(dataS$Residual.kurtosis, 
model = list(ar = 0.8, ma = 0.2), xreg 
= chind(1, data$Torque) ) 
zap.Res.kur.ARIMA.res<-— 
arima.diag(zap.Res.kur,plot=F) $std.res 
id 
first <- zap.Res.kur.ARIMA.res 

} 

if(k == 2) { 
zap.Res.rms<-— 
arima.mle(dataSResidual.rms,model= 
list(ar = 0.8, ma = 0.2), xreg = 
chind(1, data$Torque) ) 
zap.Res.rms.ARIMA.res<-— 
arima.diag(zap.Res.rms,plot=F) S$std.res 
id 
second <- zap.Res.rms.ARIMA.res 

} 

if(k == 3) { 
zap.Geardisfault<-— 
arima.mle (dataSGearDisFault,model= 
list(ar = 0.8, ma = 0.2), xreg = 
chind(1, data$Torque) ) 
zap.Geardisfault .ARIMA.res<-— 
arima.diag(zap.Geardisfault, plot = 
F)$std.resid 
third<-— zap.Geardisfault.ARIMA.res 

} 

if(k == 4) { 


zap.fmP2P <- 


arima.mle(dataSfmP2P,model= list(ar 


0.8, ma = 0.2), xreg = cbind(l, 


dataS$Torque) ) 
zap.fmP2P.ARIMA.res<-— 
arima.diag(zap.fmP2P,plot=F) Sstd. 
resid 
fourth <- zap.fmP2P.ARIMA.res 
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re 
re 


} 








) 


LE(K ==5) { 
zap.sm.1<- 
arima.mle(dataSsm.1,model= 
list(ar = 0.8, ma = 0.2), xreg = 
cbhind(1, data$Torque) ) 
zap.sm.1.ARIMA.res<-— 
arima.diag(zap.sm.1,plot=F)Sstd. 
resid 
fifth <- zap.sm.1.ARIMA.res 

















} 

Lie =—.6)° 2 
zap.sm.2<-— 
arima.mle(data$sm.2,model= 
list(ar = 0.8, ma = 0.2), xreg = 
chind(1, data$Torque) ) 
zap.sm.2.ARIMA.res<-— 
arima.diag(zap.sm.2,plot=F)S$std. 
resid 
Sixth <- zap.sm.2.ARIMA.res 








} 

if(k == 7) { 
zap.sigAvg.rms<-— 
arima.mle(dataSsigAvg.rms,model= 
list(ar = 0.8, ma = 0.2), xreg = 
chind(1, data$Torque) ) 
zap.SsigAvg.rms.ARIMA.res<-— 
arima.diag(zap.sigAvg.rms, plot=F)Sstd. 
resid 
seventh<- zap.sigAvg.rms.ARIMA.res 























NewC IName<-— paste ("NewCI.", Latex; 
".") jatxt, sep = 7") 

NewCI <a matrix(c(first, second, 
third, fourth, fifth, sixth, seventh), 
ncol = 7) 

assign (NewCIName, NewCI,where = 1) 








turn (invisible()) 
turn (NewCI 
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5. make.mahanew function 


function (gears, 


{ 


tails, name.onl 


make.maha: compute Mahal 


yi) 


lanobis distance for 





particular gear and tail 


Arguments: 


number 





gears: 








vector of character string with name of gear 














if TRUE, 





name.only: 
ame 





Construct name of data set, 


# 
# 
# 
# 
# 
# 
# tails: 
# 
n 
# 
# 
# 
1 


vector of character string with tail number 
just return condensed version of # 


then go get it 


f (missing (gears) | |missing (tails) ) 


stop ("Both arguments 


if (name.onlyéé& (length (gears) >1||length (tails) 





oxy 


stop("Not set up for 
for(i in 1l:length(gears) ) 











must be supplied!") 
> 1)) 





vectorized names!") 


{ 


i.txt <- gears[i] 
if (substring(i.txt, 1, 1) 



























































am WH) 








i.txt <- substring(i.txt, 2, nchar(i.txt)) 

if (substring(i.txt, 9, 9) == "#") 
Tact xe <- paste (substring(i.txt, ihe; 8), 
substring(i.txt, 10, nchar(i.txt)), collapse = 
Ww nm) 

i.txt <- unlist(unpaste(i.txt, sep = " ")) 

d.txt <- i.txt[i.txt != ""] 

i.txt <- paste(i.txt, collapse = "") 

for(j in l:length(tails)) { 


j.txt <- tails[j] 


saved ("maha") and 


maha.nm<-—paste ("Maha. 


if (name.only) 

return (maha.nm) 
data.nm<-—paste ("NewC 
sep="") 
if (!'exists (data.nm) ) 
stop (paste ("No 














It exists. 


ata <- get (data.nm) 





Se HE FE OO. FE OSE OE 
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5) 
# 
# Construct the names of 
ci 
# 














the things to be 
the data ("NewCI") 
Mish ety" a Ext ysepse") 
Te Md cet pty cais EXE, 





If it's character data, 


data set named", data.nm) ) 


Go get it. 


fix it 


if (is.character (data) ) 


data<-matrix(as.numeric(data),ncol= 


ncol (data) ) 
# 
# Compute column-wise means, 
pxl row matrix 


# 








assemble into a # 


m <-— apply(data, 2, mean, na.rm = T) 
m <- matrix(m, nrow = 1) 

# 

# Compute (x - mean) by replicating mean as # 
necessary 

# 

th <- data - m[rep(1l, nrow(data)), ] 
# (X - mean(x)) 

# Compute covariance matrix, get Maha 
# distance 

# 

vmat <- var(data, na.method = "omit") 


maha <- diag(th %*% vmat %*% t(th)) 


assign(maha.nm, maha, where = 


} 


turn (invisible()) 
turn (maha) 


EES 
re 





6. make.maha.analysis function 


function(maha, delet xtremes = 0.999999) 


{ 





if (missing (maha) ) 


1) 


stop ("Mahalanobis argument must be supplied!") 


# 
# Strip off that leading NA 
if (is.na(maha[1])) 

maha <- maha[-1] 


















































xtrem 


cut off any distances 
th 
By default it's 
f by passing "FALSE." 











S==TRUE) 











0.999999 
xtremes)) { 


let xtremes < 
f(is.numeric (delet 





# 

# If "delete.extremes" is TRUE, 

# more extreme than the "delet xtreme" 
# percentage point of the exponential. 

# a percentage point; turn this of 

# 

if (is.logical (delet xtremes) &&delet 

d 

i 




















gof.save<-—chisq.gof (maha,distribution 
rate = 1/(mean(maha)), n.param.est = 1) 
cutoff <- gexp (delet xtremes, rate = 








num.cutoff <- sum(maha > cutoff) 
if(num.cutoff > 0) { 
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= "exponential", 


1/mean (maha) ) 


warning (paste ("Cut 


substitute (deparse (maha) )), 


off", nium. cutott,; "outliers in", 


We 


’ 


old p-value was , 


signif (gof.saveSp.value, 4), "\n") 


maha <-— maha[maha <= cutoff] 


} 
} 

















final.chisq<-chisq.gof(maha, distribution = "exponential", 
rate = 1/(mean(maha)),n.param.est = 1) 
final.ks <- ks.gof(maha, distribution = "exponential", rate 


= 1/(mean(maha) ) ) 
print (final.chisq) 
print (final.ks) 











return (c(final.chisgSp.value,final.ksSp.value, num.cutoff) ) 
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APPENDIX B GOF TEST RESULTS FOR EXPONENTIAL 
DISTRIBUTION USING BONFERRONI 


CORRECTION 


The dark colored cells mean that th 





related p-values 
are greater than the Bonferroni adjusted significance level 


of 0.0002193. 


Index Mahalanobis Distance Name No Chi-Square gof KS gof 


1 
1 
1 
1 
2 
2 
2 
2 
3 
3 
3 
3 
4 
4 
4 
4 
5 
5 
5 
5 
6 
6 
6 
6 
7 
7 
7 
7 
8 
8 
8 
8 





.2GenShf 
.2GenShf 
.2GenShf 
.2GenShf 
.2InpshftAftidl 
.2InpshftAftiIdl 
-2InpShftAftidl 
.2InpshftAftiIdl 








hs 
hs 
EngFrwhs 
EngFrwhs 














achsShf 
achsShf 
achsShf 
achsShf 























tSpur 
tSpur 
tSpur 
tSpur 








tCamGear.1 
tCamGear.1 
tCamGear.1 
tDrvSpur.1 
tDrvSpur.1 
tDrvSpur.1 


tDrvSpur.1 


EngFCDrvShftSpur.162494 
EngFCDrvShftSpur.163075 
EngFCDrvShftSpur.163086 
EngFCDrvShftSpur.164539 


tCamGear.1 





.162494 
.163075 
. 163086 
. 164539 


EngInpShftSpur.162494 
EngInpShftSpur.163075 
EngInpShftSpur.163086 
EngInpShftSpur.164539 


.162494 
. 163075 
. 163086 
. 164539 


.162494 
~163075 
. 163086 
. 164539 
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oooo;joo0oo0ojoeoe0eoe0ojcoaoaooojooaoojooaoojronaoeaojcor ooo 


. 3748739000 
. 3657477000 
.0012292210 
.0000498706 
. 0369843500 
.0041954820 
.0340014000 
-0000945735 
.0033658590 
.0699241400 
. 3594478000 
- 0000000350 
. 1479257000 
. 3168349000 
.0148596500 
-0001565313 
. 1365716000 
. 0430359500 
.5114722000 
.0000000053 
. 0636493900 
.0580401100 
. 1699629000 
-0000218801 
.0637712400 
.0480404400 
.0954713500 
.0015239180 
0829717000 
- 4776873000 
.0005505253 
.0007459824 


oooo|too0oo0oo0o0aoojoooojcoo0oo0o;jooaoe0o0olfooe0oe0ojcrc oo 90 


.0791666800 
. 5025112000 
. 0439324800 
- 0000038110 
. 6079170000 
.0441714200 
. 0438103100 
. 0023453220 
.0170915500 
.0161819700 
- 4238913000 
0000002973 
.0016803680 
. 6142077000 
. 0306954200 
-0000727556 
. 3819240000 
.0014587820 
.0958062800 
0000003074 
. 1905592000 
.0515810500 
- 6952633000 
.0007740179 
. 3091500000 
. 1267582000 
. 0223861700 
.0040696120 
. 3815830000 
- 5649648000 
- 2728207000 
. 0095353930 





Mahalanobis Distance Name 


-2InpShf 
-2InpShf 
-2InpShf 
-2InpSh 
-2InpShf 
-2InpShf 
-2InpShf 
-2InpShf 





-AGBActS 
-AGBActS 





-AGBEngS 
-AGBEngS 
-AGBEngS 
-AGBEngS 








- AGBOPSh 
- AGBOPSh 
- AGBOPSh 
- AGBOPSh 








-AGBActShf 
-AGBActShft 
-AGBActSh 
-AGBActShf 
-AGBActShft 


-AGBActShf 


-AGBGen1S 
-AGBGen1S 
-AGBGen1S 
-AGBGen1S 
.AGBGen3S 
.AGBGen3S 
.AGBGen3S 
.AGBGen3S 





hf 
hf 





hf 
hf 
hf 
hf 


ctr 
Cre 


Lie 





Cr 





hft 
hft 
hft 
hf 


ftSpur.1 
ftSpur.1 
ftSpur.1 
ftSpur.1 


.162494 
~163075 
. 163086 
. 164539 





ler.162494 
ler.163075 
ler.163086 
ler.164539 








tShftSpur.162494 
tShftSpur.163075 
tShftSpur.163086 
tShftSpur.164539 














-AGBStg2SrvPmpShftSpur.163075 
-AGBStg2SrvPmpShftSpur.163086 
-AGBStg2SrvPmpShftSpur.164539 
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Ow olzZ 
MO & Wlo 
oooyjoooooe0oeoooo0oeo0oo0oec9ceojooooo0oed0eeooo0oe9eo0oo ao0ooro0eoe0oo0o;lo ae0nc7e 


w o]h 
BW 1 


Oo 
NO 


ww olf 
ov Cla 


ww ol ww ol ww ol ww old ww o 
CDH OCTa FLY Clea © Y Clan © LY Cla © YL © 


WW Oo 
co WO O 


WW Oo 
co O O 


w wl 
CO OlsS 


ine) 
bh 
oO) 


Chi-Square gof KS gof 


. 1729916000 
. 1688859000 
4315571000 
.0000512785 
.0019748370 
. 1688859000 
. 5536479000 
.0106145300 
. 1109026000 
.0298144600 
. 2916541000 
.0056000150 
0400923300 
. 2969329000 
0385024600 
.0009973003 
. 1105259000 
. 8648678000 
. 2213292000 
. 0026133800 
.0366537800 
- 4798044000 
. 1218870000 
.0031395750 
0000286636 
.2272758000 
. 3774363000 
.0245094900 
.0039748860 
. 3812781000 
.0009150034 
. 0025338340 
.0006621484 
. 2603022000 
. 2546023000 
.0001620264 
0192180900 
- 4288799000 
. 2213292000 
.0245094900 
. 1480693000 
. 2213292000 
.0000621991 


ooojoooooo0o0oeojooo0oo0oo0oeo0oe°o0qooo0oo0qoo oo0oo0ojoo0o0oojroo0oo0olo0oe0o0o|loaoa0oo 


. 1782416000 
- 2399904000 
. 3862667000 
.0396911700 
. 0022502640 
. 0535416900 
. 2674302000 
.0187534900 
. 1122277000 
. 2070951000 
. 3702179000 
. 1704107000 
. 2174343000 
. 3026031000 
. 0033220030 
.0108290100 
. 1543901000 
- 9787855000 
. 3685031000 
. 1420335000 
- 5991601000 
. 9160088000 
. 1098200000 
.0425268100 
.0041275020 
. 7600296000 
. 3392619000 
.0650491900 
. 1567953000 
. 6079638000 
0127535200 
. 0306988000 
. 0319469700 
- 4511475000 
.0899478600 
. 0218363500 
.0281025400 
- 6370583000 
. 6146984000 
.0747140200 
. 2531048000 
- 4064030000 
.0136492000 





-AGBUtPmpShftSpur.162 
-AGBUtPmpShftSpur.163 
-AGBUtPmpShftSpur.163 
-AGBUtPmpShftSpur.164 
-AGBWchPmpShftSpur.16 
-AGBWchPmpShftSpur.16 
-AGBWchPmpShftSpur.16 
-AGBWchPmpShftSpur.16 


lades 





lades 





lades 
fFtGear.1 
fFtGear.1 











ftGear.1 
-GrndsStgl 
-Grndstgl 
.GrndStgl 
-Grndstg2 
-Grndstg2 
.GrndStg2 
. IGBInpShftPin.162494 
. [IGBInpShftPin.163086 
. [GBOutShftGear.16249 
. [GBOutShftGear.16307 
. [GBOutShftGear.16308 
. [GBOutShftGear.16453 
. [GBOutShftPumpBl 
. [1GBOutShftPumpBl 
. [GBOutShftPumpBl 
. [GBOutShftPumpBl 
ainRtrShftoPSpur.16 
ainRtrShftoPSpur.16 
.-MainRtrShftOPSpur.16 
hShftSpur. 
hShftSpur. 
hShftSpur. 
hShftSpur. 
tSpur.1624 
tSpur.1630 
tSpur.1630 
tSpur.1645 















































Ss js ts is. iS SS 











a 
a 
a 
a 
a 
a 
a 
a 
a 
a 
a 
a 
a 
a 
a 
a 





<= 


494 

O75 

086 

539 
2494 
3075 
3086 
4539 
.162494 
. 163086 
. 164539 
62494 
63086 
64539 


4 

5 

6 

9 
.162494 
» 163075 
. 163086 
. 164539 
2494 
3086 
4539 
162494 
163075 
163086 
164539 
94 

gee) 

86 

39 


ha.OuterShaftMainBev.162494 
ha.OuterShaftMainBev.163086 


67 





0.0261544000 | 0.0529617500 
0.3062189000 | 0.3174911000 
0.0013595550 | 0.0071380010 
0.0520471600 | 0.2971274000 
0.4500622000 | 0.3625316000 
0.0052367110 | 0.0486329300 
0.3959118000 | 0.2298150000 
0.9077655000 | 0.8541475000 
0.0179124000 | 0.3808594000 
0.2856284000 | 0.7498076000 
0.1286267000 | 0.5020362000 
0.0821774600 | 0.0777073500 


0.1005221000 | 0.2943942000 
0.1246928000 | 0.4000300000 


0.0000460976 | 0.0002195990 
0.1425494000 | 0.0588983300 
0.0000000000 | 0.0000002919 
0.0746511600 | 0.2949536000 
0.0000529905 | 0.0001117883 
0.1425494000 | 0.3137684000 
0.0001247872 | 0.0000183008 
0.0016775260 | 0.0146860100 
0.0001068427 | 0.0040404190 
0.3062189000 | 0.9158680000 
0.0200847200 | 0.0481922700 
0.1166787000 | 0.0409124800 
0.0326580900 | 0.7861486000 
0.6845130000 | 0.7474594000 
0.1072321000 | 0.0692328500 
0.0104796900 | 0.0701250500 
0.3168349000 | 0.2736407000 
0.1724879000 | 0.0271953700 
0.0811854500 | 0.0747964600 


0.3109492000 | 0.4856828000 
0.0233787700 | 0.1957528000 





Mahalanobis Distance Name No Chi-Square gof KS gof 


ha.Outers 
-Outers 
-Outers 
-Outers 


haftMainBev.164539 
haftSunGear.162494 
haftSunGear.163086 
haftSunGear.164539 
FLACCPi.162494 
FLACCPi.163075 
LACCPi.163086 
FLACCPi.164539 
































EngInps 
NGBFCDrvShf 
NGBFCDrvShf 
NGBFCDrvShf 
NGBFCDrvShf 
NGBFCDrvShf 
NGBFCDrvShf 
NGBFCDrvShf 
NGBFCDrvShf 
NGBFCDvnShf 
NGBFCDvnShf 
NGBFCDvnSh 
NGBFCDvnShf 
-PortNGBOPDrvsS 
-PortNGBOPDrvS 
-PortNGBOPDrvsS 
-PortNGBOPDrvsS 
. PortNGBOu 
- PortNGBOu 


















































tACCSpur.162494 
tACCSpur.163075 
.PortNGBOu tACCSpur.163086 
.PortNGBOu tACCSpur.164539 
.PortNGBOu tGear.162494 

. Port NGBOu tGear.163075 

. Port NGBOu tGear.163086 
.PortNGBOu tGear.164539 
.PortNGBTachShftSpur.162494 
-PortNGBTachShftSpur.163075 
-PortNGBTachShftSpur.163086 
-PortNGBTachShftSpur.164539 
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. 5991661000 
- 4500622000 
0150263200 
. 0219083200 
.0709423700 
.0019700140 
.0000000387 
.0995602000 
- 4500622000 
- 4666952000 
. 2535967000 
.0188582600 
.0348115800 
. 1258339000 
.0035879460 
. 3325939000 
- 4782304000 
.0062491490 
.0943744600 
. 5334521000 
. 2546023000 
-0000611931 
.0005328204 
. 8221806000 
. 7092986000 
. 0386258400 
. 1109026000 
- 4260713000 
0887824000 
. 0000000000 
0248275200 
-0000120340 
.0011579580 
.0724376400 
.0264978700 
. 0089832700 
.0000204813 
.0731116000 
.0366537800 
. 8722260000 
. 1218870000 
0000000000 


0. 


0.1480942000 | 0.3900619000 


3332178000 


- 2655298000 
.0170488000 
.0141299400 
. 3166578000 
. 2014757000 
-0001546579 
.0371758200 
- 4384801000 
. 2765908000 
.0164562100 
.0114002600 
.0067354960 
. 0063320690 
. 0186399300 
. 3163830000 
- 9824403000 
. 0002623695 
. 1783191000 
- 5918447000 
. 7759360000 
-0000458461 
.0000846702 
. 8943008000 
- 5676922000 
. 1650291000 
- 5885142000 
- 9965774000 
.0401910400 
-0000002919 
. 2222217000 
.0056900410 
.0005197010 
. 3204947000 
. 2391644000 
.0005709405 
-0000048697 
.0007343518 
. 1025068000 
- 6554800000 
.0103405600 
0000002919 





-RrCovidlerShftIdl 
-RrCovidlerShftIdl 
-RrCovidlerShftIdl 
-RrCovidlerShftIdl 
pRotPmps 








pRotPmps 








pRotPmps 
tGear.162494 
tGear.163086 
tGear.164539 
-StbdAftInpDrvs 
-StbdAftInpDrvs 
.-StbdAftInpDrvs 
EngInps 














EngInps 
EngInps 











EngInps 
. StbdNGBFCDrvShftGear.1 
. StbdNGBFCDrvShftGear.1 
. StbdNGBFCDrvShftGear.1 
. StbdNGBFCDrvShftGear.1 
. StbdNGBOPDrvShf 
. StbdNGBOPDrvShft 
. StbdNGBOPDrvShf 
. StbdNGBOPDrvShf 
. StbdNGBOu tPin.162494 
. StbdNGBOu tPin.163075 
. StbdNGBOu tPin.163086 
. StbdNGBOu tPin.164539 























lHydPmpShftSpur.162494 
lHydPmpShftSpur.163075 
hftSpur.164539 
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. StbdNGBTachShftSpur.162494 
. StbdNGBTachShftSpur.163075 
. StbdNGBTachShftSpur.163086 
. StbdNGBTachShftSpur.164539 


Maha.Stg2SunShftGear.162494 


.0000337472 
- 4194763000 
. 3591061000 
.0000000195 
.0581608200 
. 2011345000 
.0168386900 
.0909359800 
. 2491190000 
.0761383800 
.0053022850 
. 1613175000 
- 4358976000 
.0000048610 
-0001173497 
.0012476810 
-0000440885 
. 6208552000 
. 1480693000 
.0754701900 
.0095454600 
- 4632375000 
. 2272758000 
- 4782304000 
. 0231873300 
-0000952857 
. 3298978000 
. 3007083000 
-0000540052 
.0060790820 
.6471191000 
. 2916541000 
. 0036782130 
.0141408600 
. 5397494000 
. 0431039200 
. 1353007000 
. 2491190000 
. 1026168000 
. 0330268900 
. 3062189000 
. 1368143000 


-0000080497 
. 2027049000 
. 7727719000 
0000003229 
. 3562893000 
- 4502288000 
. 1265429000 
. 1115068000 
- 6280054000 
. 0684803000 
.0474350100 
. 7514104000 
. 1771743000 
.0006049340 
-0002072291 
. 1539161000 
- 0000395430 
. 7571400000 
.0486905700 
. 1372257000 
.0036564800 
. 3308799000 
. 1876801000 
. 3899293000 
.0004167416 
-0000941570 
- 9418615000 
.0625590400 
.0000003801 
.0756782300 
. 3443324000 
. 0624214400 
.0021731880 
. 2324533000 
. 3713293000 
. 1071620000 
.0868184400 
. 6823691000 
. 0334438000 
.0175327600 
- 2805596000 
. 2409825000 





Maha. Stg2SunShftGear.163086 23 | 0.1286267000 
aha.Stg2SunShftGear.164539 68 0.0019751810 | 0.0828582000 

akeoffShftSpur.162494 0.0000000030 | 0.0000003194 

akeoffShftSpur.163075 0.0000603434 | 0.0018286950 


akeoffShftSpur.163086 0.0002357552 | 0.0001431754 
RTakeoffShftSpur.164539 0.0000000000 | 0.0000002932 


a. 
ha.TGBInpShftGear.162494 0.2955570000 | 0.5046692000 


05818332000 | 08910370000 


aha. 1 hftBlades.162494 0.2955570000 | 0.2851809000 

















nN 


a 
a 
a 
a 
a 
a 








Maha.1 1 hftBlades.163086 0.7404781000 | 0.8606168000 
hftGear.163086 0.5195206000 | 0.2929667000 
. TGBOutShft L 0.0000062168 | 0.0000383685 
. TGBOutShft L . 1425494000 | 0.0092620290 
. TGBOutShft L -0000000418 | 0.0000286994 
. TGBOutShf L . 0633566000 | 0.7861269000 
haftIdlerSpur.162494 -0000001031 | 0.0000073137 
haftIdlerSpur.163075 .0105821400 | 0.0096087650 
haftIdlerSpur.163086 .0014733450 | 0.0475561100 
haftIdlerSpur.164539 .0000000000 | 0.0000006539 


Table 7. Goodness of Fit Test Results for Exponential 
Distribution Using Bonferroni Correction 
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APPENDIX C WARNING AND ALARM THRESHOLD LEVELS 


THRESHOLD 
GEAR NAME TAIL NUMBER_}| WARNING ALARM 


F C Drv Shft Spur 162494 87.887 
F C Drv Shft Spur 163075 81.888 
F C Drv Shft Spur 163086 80.927 
162494 77.459 
163075 87.868 
163086 84.500 
164539 75.094 
162494 106.877 
163075 95% 255 
163086 105.643 
162494 105.091 
163075 77.942 
163086 82.881 
Inp Shft Ss 162494 121.918 
Inp Shft Ss 163075 154.378 
Inp Shft Ss 163086 108.283 
162494 85.158 
163075 106.152 
163086 104.602 
164539 84.834 
162494 73.849 
163075 105.301 
163086 93.128 
164539 91.362 
162494 80.911 
163075 98.821 
163086 74.685 
164539 68.484 
162494 94.419 
163075 115.084 
163086 87.307 
164539 80.806 
162494 127.066 
163075 124.458 
163086 126.940 
164539 92.120 
AGB Act 162494 89.184 
AGB Act 163075 76.160 
AGB Act 163086 86.037 
AGB Act 164539 73.954 
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THRESHOLD 


GEAR NAME TAIL NUMBER | WARNING 
162494 82.259 
163075 122.253 
163086 119.947 
164539 76.829 
162494 76.835 
163075 107.125 
163086 93.148 
164539 85.585 
162494 89.687 
163075 99.513 
163086 109.734 
164539 99.164 
162494 
163075 
163086 
164539 
162494 
163075 
163086 
164539 
162494 
163075 
163086 
164539 
162494 
163075 
163086 
164539 
Pmp Shft 163075 
Pmp Shft 163086 
Pmp Shft 164539 
162494 7133659 
163075 92.068 
163086 100.069 
164539 79.165 
Wch Pmp Shft Spur 162494 92.945 
Wch Pmp Shft Spur 163075 91.347 
Wch Pmp Shft Spur 163086 111.340 
Blades 162494 
Blades 163086 
Blades 164539 
162494 
163086 
164539 
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GEAR NAME 


GB Inp S 
GB Inp S 
GB Out S 
GB Out S 
GB Out S 





GB Out S 





hft Pin 
hft Pin 
hft Gear 
hft Gear 
hft Pump Blades 





hft Pump Blades 
OP Spur 
OP Spur 
OP Spur 





Main Bev 
Main Bev 
Main Bev 
Sun Gear 
Sun Gear 


Sun Gear 





TAIL 
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THRESHOLD 


ALARM 


NUMBER 
162494 
163086 
164539 
162494 
163086 
164539 
162494 
163086 
163075 
164539 
163075 
164539 
162494 
163086 
164539 
162494 
163075 
163086 
164539 
162494 
163075 
163086 
164539 
162494 
163086 
164539 


WARNING 
126.197 
107.926 
104.857 


91.471 
105.649 
78.317 
93.856 
88.492 
107.083 
94.542 
57.687 
88.019 
118.071 
103.964 
128.397 
99.226 
97.479 
162494 98.550 
163086 117.402 
164539 86.412 
162494 
163075 
163086 
162494 
163086 
164539 
162494 
163075 
163086 
164539 
162494 
163075 
163086 
164539 


82.212 
152:.383 
84.661 
122.758 


252.394 
215.852 
209.714 
188.047 
173.665 
152.492 


102.281 204.561 
all 

90.691 

81.243 162.486 


245.521 
181.382 


115.373 
176.037 
236.141 
207.929 
256.793 
198.452 
194.959 








392.165 
231.334 
284.514 
233.978 
2936251 
176.505 
186.398 
164.423 
304.766 
169.322 
245.516 





THRESHOLD 


GEAR NAME TAIL NUMBER_ | WARNING ALARM 
162494 80.069 160.138 
163075 104.075 208.149 
163086 78.103 156.206 
162494 104.766 209.532 
163075 132.108 264.217 
163086 82.404 164.809 
164539 86.576 17324153 
162494 110.329 220.658 
163075 170.428 340.855 
163086 106.975 21:3,.951 
162494 178.389 
163075 177.039 
163086 1 203.558 
164539 149.840 
162494 1 245.457 
163075 1 208.724 
164539 171.436 
Tach Shft Spur 162494 J 218.313 
Tach Shft Spur 163075 1 326.985 
Tach Shft Spur 163086 J 243.186 

Rr Cov Idler Shft Idler 163075 
Rr Cov Idler Shft Idler 163086 79.261 158.521 
hft Blades 162494 72.580 
hft Blades 163086 104.873 
hft Blades 164539 80.353 
hft Gear 162494 

hft Gear 163086 

hft Gear 164539 

bd Aft Inp Drv S 162494 82.952 
bd Aft Inp Drv S 163086 99.848 
bd Aft Inp Drv S 164539 131.998 
bd NGB Eng Inp S 162494 
bd NGB Eng Inp S 163086 109.231 218.461 
hft Gear 162494 73.778 
hft Gear 163075 101.009 
hft Gear 163086 93.446 
hft Gear 164539 90.709 
hft Spur 162494 94.256 188.512 
hft Spur 163075 98.499 196.999 
hft Spur 163086 138.161 276.321 
hft Spur 164539 119.092 238.185 


bd NGB Out Shft Pin 163075 93.032 186.064 
bd NGB Out Shft Pin 163086 107.960 215.920 
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GEAR NAME TAIL NUMBER | WARNING ALARM 
Stbd NGB 162494 99.473 198.945 
Stbd NGB 163075 104.134 208.268 
Stbd NGB 163086 138.476 276.952 
Stbd NGB 164539 105.081 210.162 
162494 150.761 
163075 179.240 
164539 187.641 
162494 227.057 
163086 212.861 
164539 202.816 
162494 216.800 
163086 154.327 
164539 161.118 








162494 
163086 





164539 


T R Takeoff Shft Spur 163075 84.947 169.893 
T R Takeoff Shft Spur 163086 169.033 
204.483 
283.838 


TGB Oil Pmp Shft Blades 162494 180.123 
TGB Oil Pmp Shft Blades 163086 95.846 191.692 
TGB Oil Pmp Shft Gear 162494 154.906 
TGB Oil Pmp Shft Gear 163086 102.383 204.765 
TGB Out Shft Gear 163075 198.007 
TGB Out Shft Gear 164539 87.637 175.275 
TTO Idler Shaft Idler spur 163075 186.985 
TTO Idler Shaft Idler Spur 163086 LEAL 155.437 


Table 8. Warning and Alarm Threshold Levels 
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